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IMAGE CORRECTION APPARATUS AND 
RECORDING MEDIUM HAVING IMAGE CORRECTION PROGRAM 

INCORPORATION BY REFERENCE 
5 The disclosure of the following priority application 

is herein incorporated by reference: 

Japanese Patent Application No. 11-157165 filed June 3, 
1999 

10 BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a color fog 
correction apparatus that corrects a color fog manifesting 
over, for instance, a photographic image that has become 

15 discolored after having been printed onto photographic 
printing paper or after having been stored over a long 
period of time on film, a photographic image obtained 
through a photographing operation performed under 
undesirable illumination conditions or exposure conditions 

20 and the like, and it also relates to a machine-readable 
recording medium having an image color fog correction 
program recorded therein. 

2. Description of the Related Art 

A color fog may occur in a photographic image 
25 obtained through an image -capturing operation performed 
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with a camera due to undesirable illumination conditions, 
incorrect exposure conditions or the like. A color fog 
may also occur when a photographic image printed on 
photographic printing paper has become discolored. Such a 
5 color fog may adversely affect the color tone of the 

photographic image, causing it to turn reddish or greenish. 
The undesirable phenomena regarding color of a 
^ photographic image described above are referred to as 

"color fog" in this specification. 
~J 10 A color- fogged image is corrected, for instance, by 

LZ? estimating the spectrum of the illuminating light and 

^ applying to the image a filter of a color that is 

Jjf complementary to the color of the illuminating light, by 

H exposing the three colors separately over different 

y 15 lengths of time when printing the image onto photographic 
printing paper and thus adjusting the degrees of color 
development to achieve color correction or by performing 
exposure correction to adjust the volumes of data 
corresponding to the three colors during digital 
20 processing to achieve color correction in the prior art. 

However, there is a problem with the method of color 
correction in the prior art achieved by estimating the 
color of the illuminating light and applying a filter to 
the image of a color that is complementary to the color of 
25 the illuminating light in that it is difficult to 
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accurately estimate the characteristics of the 
illuminating light. In addition, even if the 
characteristics of the illuminating light are accurately 
determined, there is a problem in that it costs a great 
deal of money to provide complementary color filters. 
This cost-related problem is not limited to hardware 
filters. When employing software filters, too, the cost 
of measuring a plurality of illuminating lights by using a 
reference chart to create filter data corresponding to a 
plurality of light colors is significant. 

In addition, the color correction method achieved 
through exposure correction, which utilizes filters and 
necessitates correct lengths of exposure time to be 
allowed for the three colors, is costly and requires a 
great length of time for processing. 

SUMMARY OF THE INVENTION 
An object of the present invention is to provide a 
simple and convenient color fog correction apparatus 
capable of effectively correcting a color- fogged image and 
to provide a recording medium having an image color fog 
correction program recorded therein. 

In order to attain the above object, an image 
correction apparatus according to the present invention 
comprises: an image obtaining unit that obtains image data 
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from outside constituted of a plurality of pixels each 
having a value in a color component among a plurality of 
color components; an average value calculation unit that 
calculates average values of color component values 
corresponding to individual color components in the image 
data; and a correction unit that corrects the color 
component values of individual pixels to match the average 
values of the color component values corresponding to 
individual color components with at least one specific 
reference value. 

In this image correction apparatus, it is preferred 
that the correction unit uses one common reference value 
for the plurality of color components as the reference 
value. In this case, it is preferred that the corre ction 
unit sets a value achieved by further averaging the 



average values of the color component values corresponding 
to individual color components as the common reference 
value. Or, it is preferred that the correction unit sets 
a maximum value among the average values of the color 
component values corresponding to individual color 
components as the common reference value. 

Also, it is preferred that the image correction 
apparatus further comprises a stage value calculation unit 
that determines three or more stage values between the 
average value of the color component values and a 
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specified reference value for each of the plurality of 
color components, a number of stage values being identical 
to each other among the plurality of color components, and 
the correction unit respectively sets stage values 
5 having an common order number among the plurality of color 
components as reference values for the plurality of color 
components and corrects color component values of 
individual pixels to match the average values of the color 
component values corresponding to individual color 

10 components with the reference values set for the 
individual color components . 

Also, it is preferred that the correction unit fixes 
a maximum value and a minimum value of the color component 
values corresponding to individual color components not to 

15 be corrected and corrects color component values between 
the maximum value and the minimum value by using a 
specific function . 

Another image correction apparatus according to the 
present invention comprises: an image obtaining unit that 

20 obtains image data from outside constituted of a plurality 
of pixels each having a value in a color component among a 
plurality of color components; a histogram preparation 
unit that prepares a histogram for each of the color 
components using the image data; an average value 

25 calculation unit that calculates an average value of the 
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histogram; and a histogram conversion unit that creates 
new image data by converting the histogram so that an 
average value of a histogram resulting from the conversion 
matches a specified reference value. 
5 An image correction apparatus according to the 

present invention comprises: an image obtaining unit that 
obtains image data from outside constituted of a plurality 
^ of pixels each having a value in a color component among a 

: ~: 

plurality of color components; a histogram preparation 
~ 10 unit that prepares a histogram for each of the color 

jjf components using the image data; an average value 

y = 

^ calculation unit that calculates an average value of the 

y histogram; and a stage value calculation unit that sets at 

y 

p least three stage values between each of the averages 

O 15 value and a specified reference value; and a histogram 
conversion unit that converts the histogram so that an 
average value of a histogram resulting from the conversion 
matches a stage value having a common order number among 
the plurality of the color components. 
20 In the above image correction apparatuses, it is 

preferred that the average value corresponds to a 
barycentric value of the histogram. 

Also, it is preferred that the histogram conversion 
unit converts the histogram by using an interpolation 
25 function. 
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A recording medium according to the present invention 
records a control program used in an image correction 
apparatus. The control program comprises: an instruction 
for obtaining image data from outside constituted of a 
5 plurality of pixels each having a value of a color 
component among a plurality of color components; an 
instruction for calculating average values of color 
^ component values each corresponding to one of the color 

y£ components using the image data; and an instruction for 

^ 10 correcting the color component values of the pixels to 
! jy match the average values of the color component values 

^ with a specific reference value. 

Q A data signal according to the present invention 

D embodied in a carrier wave comprises a control program 

O 15 used in an image correction apparatus. The control 

O 

program comprises: an instruction for obtaining image data 
from outside constituted of a plurality of pixels each 
having a value of a color component among a plurality of 
color components; an instruction for calculating average 
2 0 values of color component values each corresponding to one 
of the color components using the image data; and an 
instruction for correcting the color component values of 
the pixels to match the average values of the color 
component values with a specific reference value. 

25 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a flowchart of the operation performed in 
the essential portion of the image correction apparatus in 
the embodiment 1 of the present invention; 

FIG. 2 is a flowchart of the operation performed in 
the essential portion of the image correction apparatus in 
the embodiment 2 of the present invention; 

FIG. 3 is a flowchart of the operation performed in 
the essential portion of the image correction apparatus in 
the example 1 of the present invention; 

FIG. 4 is a flowchart of the operation performed in 
the essential portion of the image correction apparatus in 
example 2 of the present invention; 

FIG. 5 is the schematic block diagram of the hardware 
configuration of the present invention; and 

FIGS. 6A and 6B present interpolation functions that 
may be used in the histogram conversion. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
(Embodiment 1) 

The overall structure of the image correction 
apparatus in this embodiment of the present invention that 
employs a computer is shown in FIG. 5. 

In FIG. 5, a computer 1 is provided with a CPU 
(microprocessor) 2. An input device 3 constituted of a 
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keyboard, a mouse and the like, a hard disk 6, a memory 7, 
an image processing board 8 and an interface board 10 are 
connected to the CPU 2. A display device is connected to 
an image output terminal of the image processing board 8. 
5 An external apparatus 11 such as an external recording 
medium is connected to the interface board 10 . A CD-ROM 
drive device 12 is connected to the CPU 2, and a CD-ROM 13 
for recording an image correction program and an 
?2 installation program to install the color correction 

*if 1° program is inserted at the CD-ROM drive device 12 . 
IJf Using the installation program in the CD-ROM 13, the 

^ CPU 2 expands the image color fog correction program in 

y the CD-ROM 13 and stores it in an execution-enabled state 

C3 at the hard disk 6. 

D 15 The image color fog correction apparatus in this 

embodiment is achieved based upon a hypothesis that the 
average color of an object is, by nature, gray. Namely, 
when illuminating light of a multiple component spectrum 
is irradiated on an object and the spectral reflectances 
20 over the entire surface of the subject are averaged, the 
average spectral reflectance achieves a flat distribution 
with respect to wavelength. Thus, we tend to perceive the 
averaged color of the entire surface of the object as the 
color of the illuminating light. 
25 Based upon this hypothesis, we made the following 
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inference. The averaged color of an object irradiated by- 
illuminating light with a completely flat spectrum must 
have a flat spectrum as well. Assuming that the color of 
an object, i.e. the color of its image, with a flat 
spectrum on average irradiated by illuminating light with 
a completely flat spectrum is the most pleasing to the 
human eye, if an overall average color of the image is a 
color of gray corresponding to a flat spectrum, the color 
of the image is equivalent to a color of an image 
irradiated by a light source having a flat spectrum and, 
therefore, should be a pleasing color tone. In other 
words, if the overall average color of the image is not 
gray, correction should be implemented to adjust the 
overall average color to gray, which corresponds to a flat 
spectrum, i.e., to equalize the individual average values 
of the histograms corresponding to the individual color 
components so that any undesirable effect of illuminating 
light with a non-flat spectrum or any undesirable effect 
of incorrect exposure or discoloration can be removed from 
the image. We reached the above observation through a 
concentrated effort in research, and this embodiment is 
implemented based upon the concept outlined above. 

FIG. 1 is a flowchart of the operation achieved in 
the image color fog correction apparatus in the embodiment 
1 of the present invention. The following is an 



explanation of the image correction operation, given in 
reference to the step numbers in FIG. 1. 

First, when the user starts up the image color fog 
correction program, the CPU2 opens an image file to 
5 undergo the correction and obtains the image data (SI) . 

Next, histograms corresponding to the individual 
color components, i.e., the R, G and B color components, 
are prepared using the image data (S21, S22 and S23). 
d Then, histogram average values R ave , G ave and B ave 

00 io corresponding to the individual color components R, G and 
TU B are calculated (S31, S32 and S33) . Before proceeding to 

CO the next phase, the user specifies a reference value W 0 



Q (S2) . The specific method of W 0 specification is to be 

p detailed later. 

p 15 During the next phase, the individual histograms 

obtained in steps S21, S22 and S23 are converted so that 
the individual converted histogram average values match 
the reference value W 0 (S41, S42 and S43) . The details of 
the conversion method are to be given later. The image 

20 obtained at this time point is designated as a corrected 
image, and the image is updated (S5) . 

Since the individual histogram average values 
corresponding to the color components R, G and B each 
match the reference value W 0 in the image that has been 

25 corrected as described above, a pleasing color tone that 
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is equivalent to the color tone of an image illuminated 
with flat illuminating light is achieved. 

The individual histogram average values R ave/ G ave and 
B ave corresponding to the color components R, G and B of the 
5 image in embodiment 1 explained above are calculated as 
follows . 

R ave = 2 F R (x) • P R (x) 1 

G ave = 2 F G (x) • P G (x) | expression 1 

B ave = 2 F B (x) • P B (x) 1 

10 In the mathematical expressions above, x represents 

the brightness level of the image and is normally- 
equivalent to 8 -bit data having a minimum value of 0 and a 
maximum value of 255, and 2 represents addition of values 
regarding 0 of x through 2 55 of x. 

15 P R (x) , P G (x) and P B (x) each represents the ratio of 

the number of pixels at the brightness level x to the 
entire number of pixels in the corresponding color 
component R, G or B in the image. 

F R (x) , F G (x) and F B (x) are each an arbitrary 

20 function of x. These functions may each be expressed as x, 
x 2 , (x - x w ) 2 or the like. x w represents thejbary c^nter^ o f 
a given histogram, and is equivalent to W R/ W G and W B to be 
detailed later. Of these functions, 
F R (x) = F G (x) = F B (x) = x expression 2 

25 is particularly desirable, and when it is used, the 
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individual average values R ave/ G ave and B ave respectively 
match the barycentric values W R/ W G and W B of the 
corresponding histograms to validate relationships 
expressed as R ave = W R/ G ave = W G and B ave = W B . 
5 In addition, in embodiment 1, the reference value W 0 

should preferably assume the average value of the average 
values of the histograms corresponding to the individual 
,^ color components, i.e., W 0 = (R ave + G ave + B ave ) /3 or the 

rz maximum value among the average values of the histograms 

^ 10 corresponding to the individual color components, i.e., W 0 
jjf = max (R ave , Gave' ^ ave ) . 

^ If the average value is used, an advantage is 

D achieved in that an image faithful to the original is 

B achieved through correction, whereas an advantage is 

O 15 achieved in that a dark original image is brightened 

through the correction when the maximum value is used. 

In embodiment 1, the conversion for equalizing the 
average values of the histograms corresponding to the 
individual color components to a specified value S (the 
20 specified value S is equivalent to the reference value in 
embodiment 1 and equivalent to a kth level value in 
embodiment 2 which is to be detailed later) is achieved by 
using an interpolation function. "An interpolation 



function represented by a polygonal line (FIG. 6A) or a 
25 curve (FIG. 6B) shown in FIG. 6A or 6B may be used for the 
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conversion. It is desirable to use a curve, e.g., a 
quadratic function that achieves simplicity and 
convenience, to smoothly convert gradation levels. While 
FIGS. 6A and 6B present histograms of the color component 
R, the other color components are represented in a similar 
manner. In FIGS. 6A and 6B, x^, x^ and R ave respectively 
represent the minimum value, the maximum value and the 
average value of the brightness levels before the 
conversion . 

Furthermore, in embodiment 1, a reference value may 
be specified in S2 by setting it in advance, or it may be 
input by the user "each' time*T "~ 

Embodiment 1 is explained in further detail in 
reference to the flowchart in FIG. 3. 

First, when the user starts up the image color fog 
correction program, the CPU 2 opens the image file to 
undergo the correction and obtains the image data (SI) . 

Next, the number of pixels at each brightness level 
in the image is calculated for each color component (S211, 
S212 and S213) . 

Then, the ratios P R (x) , P G (x) and P B (x) each 
representing the ratio of the number of pixels at each 
brightness level in the image to the entire number of 
pixels are calculated for the individual color components 
to obtain corresponding histograms (S221, S222 and S223). 
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In other words, obtaining (preparing) a histogram means 
ascertaining the ratio of the number of pixels at each 
brightness level to the entire number of pixels. It is to 
be noted that the number of pixels at each brightness 
level may be ascertained instead. 

Next, the average values are calculated using 
expressions 1 and 2 during the phase that includes S31, 
S32 and S33 . The average values R ave/ G ave and B ave of the 
individual histograms thus obtained constitute the 
barycentric values of the histograms and from this point 
onward they are referred to as W R , W G and W B . 

The reference value W 0 is specified before proceeding 
to the next phase (S2) . 

Next, the histograms obtained in S221, S222 and S223 
are converted so that the barycentric values of the 
converted histograms match the reference value W 0 specified 
in S2 . 

More specifically, the conversion is implemented as 
follows. 

While the conversion is implemented by using a 
quadratic function in this implementation, another 
function may be used instead. The quadratic function f (x) 
is defined as; 

f (x) = ax 2 + bx + c expression 3 

with a, b and c each representing a constant. 
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The histogram of the color component R is now 
undergoing the conversion, with the minimum value, the 
maximum value and the barycentric value of the brightness 



levels respectively set to 0, 255 and W R . 

These values are then incorporated through 
substitution in expression 3, and f (x) is set to 0, 255 
and W 0 respectively in correspondence to 0, 255 and W R 
assumed for x. As a result, the relationships expressed 
as ; 

f (0) = c - 0 expression 4 

f (255) = a x 255 2 + b x 255 + c = 255 expression 5 and 

f (W R ) = a W R 2 + bW R + c = W 0 expression 6 are achieved. 

a, b and c are ascertained by solving the tertiary 
linear equations (three unknowns) above, i.e., expressions 
4, 5 and 6, to determine the function form of f (x) (S411) . 

The processing described above is also performed on 
the histogram of the color component G and the histogram 
of the color component B undergoing the conversion in 
parallel independently of each other, and thus, the 
function forms of f (x) are independently determined in 
correspondence to the individual histograms (S412 and 
S413) . 

Next, using the f (x) thus determined, the histogram 
of the color component R is converted. In more specific 
terms, with x representing a given brightness level before 




the conversion, each brightness level in the new histogram 
resulting from the conversion is calculated by using f (x) . 
During this process, the pixel number ratio at the 
brightness level x is converted to a pixel number ratio 
corresponding to the brightness level f (x) . The histogram 
is converted through this processing (S421) . 

In other words, during a histogram conversion, the 
values at individual levels between the maximum value and 
the minimum value are corrected using a specific function 
while leaving the maximum value and the minimum value of 
the level on the horizontal axis in the histogram 
undergoing the conversion unchanged. In the example shown 
in FIG. 6B, the brightness level 0 and the brightness 
level 255 remain unchanged, and the intermediate level, 
i.e., the brightness level 128, is corrected to a slightly 
larger value, e.g., to approximately the brightness level 
180. If there are 100 pixels at the brightness level 128 
before the histogram conversion, there will be 
approximately 100 pixels at the brightness level 180 after 
the histogram conversion although there may be an error in 
quantization. To rephrase this, a histogram conversion is 
achieved by shifting the histogram to the right or left 
while slightly changing the shape of the histogram with 
the maximum value and the minimum value of the level on 
the horizontal axis of the histogram fixed. 
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The processing described above is also performed in 
parallel on the histogram of the color component G and the 
histogram of the color component B, to convert the 
individual histograms (S422 and S423). 
5 After the histograms corresponding to R, G and B are 

converted in this manner, barycentric values W R/ W G and W B 
are calculated for the converted histograms as in the 
processing performed in S31, S32 and S33 (S431, S432 and 

O 

J3 S433) . 

83 10 Next, a decision is made as to whether not the 

fy barycentric values W R/ W G and W B a re each eq ual to W 0 (S441, 

CS S442 and S443) . 

O If they are equal to W 0 (YES) , the operation proceeds 

p to the next phase . 

p 15 If a negative decision is made (NO) , on the other 

hand, the operation returns to S411, S421 or S431 to 
repeat the loop described above until all the barycentric 
values are equalized to W 0 by further converting the 
converted histogram . 
20 When an affirmative decision (YES) is made in all 

S414, S424 and S434, the image is updated (S5) before 
ending the processing. 
(Embodiment 2) 

Since the structure of the correction apparatus in 
25 embodiment 2 is identical to that assumed in embodiment 1, 
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its explanation is omitted. 

In the image color fog correction, the gray color 
hypothesis is valid as in embodiment 1. However, when the 
hypothesis that the most pleasing image is achieved when 
5 the illuminating light has a flat spectrum and is a 

prerequisite of embodiment 1 is not valid, i.e., when the 
subject is illuminated under illumination conditions 
manifesting a unique color tone, the apparatus in this 
^3 embodiment corrects a color fog. In this situation, the 

ffl 10 average color of the image is not gray. For instance, an 
fy image of Mount Fuj i at sunset or a landscape image 

03 photographed under water may be corrected through 

Q embodiment 2. In the former case, the illuminating light 

O is bound to be reddish even though the average reflectance 

Q 15 of Mount Fuji, which is the subject, may manifest a flat 
spectrum. In other words, it is the reddish illuminating 
light that we hold in memory as a lasting impression. 
Under these circumstances, it is not desirable to 
implement the correction method in embodiment 1, since the 
20 impression of the original scene becomes lost. In 

embodiment 2, a color fog is corrected by taking into 
consideration such unique characteristics of a particular 
illuminating light. 

FIG. 2 is a flowchart of the operation achieved in 
25 the image color fog correction apparatus in embodiment 2 
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of the present invention. 

The following is an explanation of the image 
correction operation, given in reference to the step 
numbers in FIG. 2. 
5 First, when the user starts up the image color fog 

correction program, the CPU 2 opens an image file to 
undergo the correction and obtains the image data (SI) . 

Next, histograms corresponding to the individual 
color components, i.e., the R, G and B color components, 
10 are prepared using the image data (S21, S22 and S23) . 

Then, histogram average values R ave , G ave and B ave 
corresponding to the individual color components R, G and 
B are calculated (S31, S32 and S33) . 

Before proceeding to the next phase, the user 
15 specifies a reference value W 0 (S2) . 

During the next phase, differences |W 0 -R ave |, | W 0 -G ave | 
and |W 0 - B ave | between the reference value W 0 and the 
individual average values calculated during the preceding 
phase are calculated (S41, S42 and S43) . 
20 Before proceeding to the next phase, the user 

specifies the number of stages k (k 2^ 3) to be set between 
the individual average values (R ave , G ave , B ave ) and W 0 (S3) . 

During the next phase, k stage values are 
sequentially calculated between each of the average values 
25 (R ave , G ave , B ave ) and W 0 (S51, S52 and S53) . At this point, 
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the individual first stage values are designated as 
average values, and the individual kth stage values are 
each designated as a common reference value W 0 for the 
corresponding color components. 
5 Next, the individual histograms are converted so that 

the average values of the converted histograms match the 
corresponding kth stage values (S61, S62 and S63). 

^_ Next, the image is updated (S7 ) . In the next step, 

E3 

if an evaluation is performed to determine whether not the 

ijfl 

£0 10 color of the image is good (S8) . If an affirmative 
[U decision is made (YES / good color), the processing ends. 

03 If a negative decision is made (NO / poor color) , the 

O value of k is reduced by one (S9) . Next, a decision is 

D made as to whether or not the reduced value of k is equal 

O 15 to 1 (S10) . Since a negative decision (NO / k =h 1) is 
invariably made in the first loop, the operation returns 
to the phase that includes S61, S62 and S63 to convert the 
individual histograms so that the average values of the 
converted histograms become equal to the kth stage values 
20 after k is decremented by one and then the image is 

updated in S7 before making a decision in S8 as to whether 
or not the color is good. 

If an affirmative decision is made (YES / good color) 
in S8, the processing ends. If a negative decision is 
25 made (NO / poor color) , the operation proceeds to S10 via 
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S9 to make a decision as to whether or not k = 1 is true. 
If a negative decision is made (NO / k =# 1) , the operation 
returns to the phase that includes S61, S62 and S63 to 
engage in the operation explained above. 
5 If, on the other hand, an affirmative decision is 

made (YES / k = 1) , it means that the current stage value 
corresponds to the average value of the histogram of the 
original image, and the operation shifts to one of the 

CI three processing phases described below. 

Lfl 

83 10 In the first processing phase, at least either the 

Hi reference value W 0 set in S2 or the number of stages k set 

00 in S3 is changed before performing the processing in FIG. 

Q 2 again. 

□ In the second processing phase, the processing ends 

O 15' without updating the image. 

O 

In the third processing phase, the operation shifts 
to a processing phase not shown in the flowchart in FIG. 2. 

In this embodiment, the number of stages may be 
specified in S3 by setting it in advance or it may be 
20 input by the user each time. 

In addition, the k stage values assumed between each 
of the average values (R ave / G ave / B a v e ) and W 0 should be 
preferably set over equal intervals. 

In embodiment 2, and the individual average values R ave , 
25 G ave and B ave of the histograms corresponding to the color 
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components R, G and B in the image are calculated, the 
reference value W 0 is set, the histograms of the individual 
color components are converted to equalize their average 
values to the specified value S and the reference value is 
5 specified in S2 , all as in embodiment 1, and thus, their 
explanation is omitted. 

Embodiment 2 is explained in further detail in 
reference to the flowchart in FIG. 4. First, when the 

pi 

*0 user starts up the image color fog correction program, the 

3 

ffl io CPU 2 opens the image file to undergo the correction and 
ny obtains the image data (SI) . 

l0 Next, the number of pixels at each brightness level 

p in the image is calculated for each color component (S211, 

p S212 and S213) . 

ri 15 Then, the ratios P R (x) , P G (x) and P B (x) each 

O 

representing the ratio of the number of pixels at each 
brightness level in the image to the entire number of 
pixels are calculated for the individual color components 
to obtain corresponding histograms (S221, S222 and S223) . 

20 Next, the average values are calculated using 

expressions 1 and 2 during the phase that includes S31, 
S32 and S33. The average values R ave , G ave and B ave of the 
individual histograms thus obtained constitute the 
barycentric values of the histograms and from this point 

25 onward there are referred to as W R , W G and W B . 
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The reference value W 0 is specified before proceeding 
to the next phase (S2) . 

At the next phase, differences |W 0 -W R |, | W 0 -W G | and 
|W 0 - W B | between the reference value W 0 and the individual 
5 barycentric values calculated during the preceding phase 
are calculated (S41, S42 and S43) . 

Before proceeding to the next phase, the user 
specifies the number of stages k (k ^ 3) to be set between 
the individual barycentric values (W R/ W G , W B ) and W 0 (S3). 
10 During the next phase, k stage values W^, W KG and 

are sequentially calculated between each of the 
barycentric values (W R , W G , W B ) and W 0 (S51, S52 and S53) . 
At this point, the individual first stage values are 
designated as barycentric values and the individual kth 
15 stage values are designated as reference values W 0 for the 
corresponding color components. 

Next, the individual histograms are converted so that 
of the barycentric values of the converted histograms 
match the corresponding kth stage values (W^, W KG and W^) . 
20 More specifically, the conversion is implemented as 

follows. 

While the conversion is implemented by using a 
quadratic function in this implementation, another 
function may be used instead. The quadratic function f (x) 
25 is defined as; 
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f (x) = ax 2 + bx + c expression 7 

with a, b and c each representing a constant. 

The histogram of the color component R is now 
undergoing the conversion, with the minimum value, the 
5 maximum value and the barycentric value of the brightness 
levels respectively set to 0, 255 and W R . 

These values are then incorporated through 
substitution in expression 7, and f (x) is set to 0, 255 
yQ and respectively in correspondence to 0, 255 and W R 

y i 

CO 10 assumed for x. As a result, the relationships expressed 

fU as ; 

ED f(0) = c = 0 expression 8 

Q f (255) = ax 255 2 + b x 255 + c = 255 expression 9 and 

CP 

q f (W R ) = aW R 2 + bW G + c ■ = expression 10 are achieved. 

p 15 a, b and c are ascertained by solving the tertiary 

linear equations (three unknowns) above, i.e., expressions 
8, 9 and 10, to determine the function form of f (x) (S611) . 

The processing described above is also performed on 
the histogram of the color component G and the histogram 
2 0 of the color component B undergoing the conversion in 
parallel, independently of each other, and thus, the 
function forms of f (x) are independently determined in 
correspondence to the individual histograms (S612 and 
S613) . 

25 Next, using the f (x) thus determined, the histogram 



25 



of the color component R is converted. In more specific 
terms, with x representing a given brightness level before 
the conversion, each brightness level in the new histogram 
after the conversion is calculated by using f (x) . During 
5 this process, the pixel number ratio at the brightness 
level x is converted to the pixel number ratio 
corresponding to the brightness level f (x) . The histogram 
is converted through this processing (S621) . 

The processing described above is also performed in 

10 parallel on the histogram of the color component G and the 
histogram of the color component B, to convert the 
individual histograms (S622 and S623). 

After the histograms corresponding to R, G and B are 
converted in this manner, barycentric values W R , W G and W B 

15 are calculated for the converted histograms as in the 

processing performed in S31, S32 and S33 (S631, S632 and 
S633) . 

Next, a decision is made as to whether not the 
barycentric values W R , W G and W B are respectively equal to 
20 W^, W kg and (S641, S642 and S643) . 

If they are equal to W^, W KG and (YES) , the 

operation proceeds to the next phase, respectively. 

If a negative decision is made (NO) , on the other 
hand, the operation returns to S611, S621 or S631 to 
25 repeat the loop described above until the converted 
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barycentric values are equalized to W^, W KG and 
respectively through further conversion. 

When an affirmative decision (YES) is made in all 
S641, S642 and S643, the image is updated (S7) . In the 
5 next step, an evaluation is performed to determine whether 
or not the color of the image is good (S8) . If an 
affirmative decision is made (YES / good color) , the 
processing ends. 

yg If a negative decision is made (NO / poor color) , the 

y \ 

08 10 value of k is reduced by one (S9) . Next, a decision is 

Jr 

fy made as to whether or not the reduced value of k is equal 

Q3 to 1 (S10) . 

Q Since a negative decision (NO / k =# 1) is invariably 

g made in the first loop, the operation returns to the phase 

'~ 15 that includes S611, S612 and S613 to determine the 
™ function forms of f (x) for the individual color components 

corresponding to the kth stage values after k is 
decremented by 1 and the operation proceeds through the 
phase that includes S621, S622 and S623, the phase that 
20 includes S631, S632 and S633 and the phase that includes 
S641, S642 and S643 before the image is updated in S7 and 
a decision is made as to whether or not the color is good 
in S8 . 

If an affirmative decision is made (YES / good color) 
25 in S8, the processing ends. If a negative decision is 
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made (NO / poor color) , the operation proceeds to S10 via 
39 to make a decision as to whether or not k = 1 is true. 

If a negative decision is made (NO / k =t= 1) , the 
operation returns to the phase that includes S611, S612 
5 and S613 to engage in the operation explained above. 

If, on the other hand, an affirmative decision is 
made (YES / k = 1) , it means that the current stage value 
corresponds to the average value of the histogram of the 
J3 original image, and the operation shifts to one of the 

m 10 three processing phases described below. 

f|j In the first processing phase, at least either the 

m reference value W 0 set in S2 or the number of stages of k 

□ set in S3 is changed before performing the processing in 

fTs 

q FIG. 4 again. 

15 In the second processing phase, the processing ends 

^ without updating the image. 

In the third processing phase, the operation shifts 
to a processing phase not shown in the flowchart in FIG. 2. 
As explained above, in embodiment 1 of the present 
20 invention, an image is corrected to achieve a color tone 
equivalent to the color tone of an image when the natural 
color of the object is gray and the illuminating light is 
flat. In embodiment 2, the barycentric values of the 
histograms can be converted with a high degree of 
25 flexibility to achieve an image correction in a desirable 
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manner while retaining the impression of the color tone of 
the illuminating light used during the photographing 
operation even when the prerequisite hypothesis of 
embodiment 1, i.e., the hypothesis that the most desirable 
image is achieved when the illuminating light has a flat 
spectrum, is not valid, since the image is photographed 
under illumination conditions manifesting a unique color 
tone. Through examples 1 and 2, in which quadratic 
functions are used for histogram conversion, the 
brightness levels can be smoothly converted to obtain a 
corrected image that is pleasing to the eye. 

While the explanation is given in reference to the 
embodiments above on an example in which the image 
correction program and the installation program for 
installing the image correction program are provided in a 
recording medium constituted of the CD ROM 13, the 
recording medium may be constituted of any other form of 
memory. All types of recording media including magnetic 
tape, DVD and the like may be employed in the present 
invention . 

In addition, these programs may be provided via a 
transmission medium such as a communication line, a 
typical example of which is the Internet. In other words, 
the programs may be converted to signals on a carrier wave 
that transmits through the transmission medium and be 




transmitted. A computer 1 in FIG. 5 is provided with a 
communication interface 21 connected to a communication 
line 22. A computer 23 is a server that provides the image 
correction program in which the image correction program 
is stored. The communication line 22 may be a 
communication line for Internet connection or a 
communication line for a personal computer, or it may be a 
dedicated communication line. The communication line 22 
may be a telephone line or a wireless telephone line such 
as a mobile telephone line. 
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